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This booklet describes a research program that 
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developed eight Educational Leadership Appraisal sig exercises 
sp2cifically relevant to the roles of middle-manag2m2 
state education agencies (SEAs). 
-for the observation; 
in educational managers and administrators. 
appraises an individual along 20 leadership dimensions that.are 
qrouped into the broader categories of "Management and Organization,’ 
- "Communication," "Problem-Solving," "Task Orientation," and 
"Interpersonal Qualities." Behavior along the Leadersii 
Aas elicited through a set of individual and group situational 
exercises, role-playing tasks, analysis problems, intervigws, ani 
writing and speaking assignments. (Authoc/JG) © 
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ELA is a performance-based procedure 
assessment, and training of leaiership behavior 
This new SEA/ELA systen, 


ip dimensions 
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Documents acquired by FRIC include many informal unpublish2d 
materials not available from other sources. 
to obtain the best copy available. Nevertheless, items of narginal 
reproducibility are often encountered and this affacts the quality 
of the microfiche and hardcopy reproiuctions ERIC nakes available 
via the ERIC Document Reproduction Service (EDRS). EDRS is not 
responsible for the quality of the otiginal document. R2productions 


supplied by EDRS are the best that can be made from the original. 
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Many people contributed to the sucggss of this project. First, we 
are grateful for the unstinting cooperation of more than 30 SEAs that pro- a (ee 
vided essential information on their operations, particularly at the» , ; 
middle-management level, and a list of their principal «training concerts.” 
Thanks fo also to the Honorable Dr. Barbara Thompson, Maggie Burke and F : - 
the staff of the Wisconsin State Department of Education, and the honor- 
able Dr. Thamas Schmidt and the staff of the Rhode Island Department of - , . 1 ¥ 
» Education for their assistance in developing and testing items of per- i 
formance-based exercises to be used in SEAs. The project.wishes to . ‘ 
acknowledge the assistance of others in both the public and private sector: 

Janice Zimbler wf the U.S. Civil Service Commission; Dr. John Kurutz and 

others on the staff of the U.S. Postal Service Training and pe een. : | 
Institute; Dr. Thomas J. Burns, Associate Commissioner, U.S. Office of , . ; 
Education; Dr. Robert Solomon, Executive Vice President, Educational ; : 
Testing Service; Dr. Joel S. Berke, Director, Educational Policy Researcn Aa 
Institute, Fducational Testing Service; David S. Bushnell and Sol Lavisky, | 
Human Resources Research Organization; Dr. Warren Hill, Execiitive Director, , | 
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_ Education Commission of the’ States; Dale Durkee, Training Director, Florida 


Power and Light; Victor Leavengood, General Telephone of Florida; Rithard 

‘Arnold; Director of Educational Programs, American Telephone and Telegraph; 

. William J. J. Gordon, President, Synectics Education Systems; Dr: Jac! Jf 
Culbertson and Dr. Dick Podemski , University Council for Educational Admini- ° 
stration; Dr. William Davis, Department of Education, Oklahoma State Univer--. 
sity; Dr. Leon M, Lessingér, Dean, School of Education, University of ae 

Carolina; Meg Conner, Executive Vice President, The Women's Institute/ ' 


- Amertcan University; Dr. Ruth Mylecraine, Advisory Committee on Women's 


Educational Programs; Ms. Mariana Miko, Resource Center for Planned Change, 
American Association of State Colleges and Universities; Dr. Robert EF. 
Corrigan, President, Corrigan ates; Dr, John Thurber, Director of 
"Staff Development , West Palm Beach lic Schools; Dr. Donald Mitchell, 
Director, National Fd.D. Program for Educational Leaders, Nova University; 

| Dr. Edward Foulker, U.S. Department of Agriculture Graduate School; Dr. 
Allan Bllis, President of EducationAl Research Corporation, Dr. Leonard, 
Glick and the staff of-ERC; Dr. Adrienne Bank, Associate Director, Center , 
for the Study of Evaluation, UCLA; Dr. Paul lfersey, National Association ‘ 
of Secondary School Principals; Anne Elmore, North Carolina SEA. 


: We wish to thank the following fndividedie for their help in plan-ing 
this project: Dr. Edward Brainard, Colorado SFA; Dr. Jesse Coles, South e 
Carolina SEA; Dr. H. T. Conner, North Carolina SEA; Dr. Marshall Frinis, = 
Florida SFA; Dr. Bernarr Furse, Utah SEA; Robert Greer, Ohio SEA; Ron ae 
lackie, Georgia SEA; Charles Nix, Texas SEA. ® , : 


We are grateful to Ralph Bohrsgn, Program Officer at The Ford Founda- 
tion for his Support and advice throughout the project. a. ‘ 
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To the staff of the Council of Chief State School Officers, cwe : Pate F 
appreciate all the help Scent the nrejeet, : a sate 

And to the’ members of the, Task Faves anes a profound expression eto ao? ) 
admiration and grafftude for the hours of work they put into thig projét. 
Nothing would have been possible without their help. 
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Human enterprises are an amalgam of procegs and product, of complex 


- interactions and numerous transactions, of personal and collective aspira-, 


tions, of compromise. The SEA/Staff Development Project was no except fon. ‘ ’ 
What was exceptional about the project, however -- in degree, if not in 


- kind -- was ‘the quality of help bard counsel provided by a group of out- 

standing advisors, under the chairmanship of Charles Nix, Anasetate 

“4 . 
Commissioner for Planning with the Texas Education Agency. “Indeed, the ° o 


“advisors passionate’ commitment to the project's goals preted considerable 


a 


inspiration and — Their diligent, reasoned scrutiny of various © 
aspects of the project helped -to get at the essence of things. In their 
persistence, they conducted what 7.-S; Eliot calls a relentless "'raig@ Gn 
the inarticuldte”. _ The ultimate effect of their ref inement-by-reason was 
that some infeianiy- stated goals dine not accomplished, due doubtless to a 
widespread , initial eaien cd to apprehend adéquately the complexities in- 
volved. On the ottier® hand, significant progress was made toward ides y- 
ing abgpPinpointing some of the critical staff development needs in SEAs 
and the parameters for action. Indeed, the SEA/Staff Development Project - 
can boast proudly that it developed the first comprehensive process for 
determining the idiosyncratic training needs of SEAs, using performance- 
« based criteria add processes. In effect, the strategy evolved for the’ 
= Eee was concerned.with depth rather than breadth. The result was ia 


an 
' that more of the significant goals were accomplished by attempting less. 
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THE SEA/STAFF .DEVELOPMENT PROJECT 


te 


_ Project Mission 


? 
After.considerable refinement, the project's mission was formulated as 
follows: 4 


To create a way of: 

1. Providing Chief State School Offfcers with alternative 
methods,’ structures, and strategies to meet identified 
needs primarily for top- and middle-level management of ° 
the SEA. 
Providing developmental strategies and methods:for the 
chief and hie inmediate team in proactively directing 
the Agency toward established objectives. 


’ 


Serving as a clearinghouse for information on programs 
doproariats for SEAs. 


Providing assistance in developing ae and 
processes for a continuing assessment of_SEA needs. 
Underlying Propositions 


The mission and project strategies were based on the fol lowing 
propositions: : 


AN 


Underlying Propositions - 


In planning programs for the project, the following propositions 
will serve as guidelines: 


Focus on 
Priority 
Concerns 


Training for 
Future Needs 


© 


:. Support of Chief 
State School 
Officers 


No “Cookbook” 
Approaches 


Development of 
A Utilization 
Mechanism 


Organizational 
Development 


Transportability 
of Programs 


Proposition #1; Assuming a commonality of, | 


priority Concerns, in spite of considerable dig? . 
versity among SEAs, program development 
should focus on selected priorjties, with built- 
in flexibility to meet individual agency needs. 


Proposition #2: Programs should be devel- 
oped (6 address not only present-day exigen- 
cies but prepare SEA staffs for anticipated and 
emerging roles and responsibilities. 


Proposition #3: Programs of the project 
should be designed to provide maximum sup- 
port to the Chief State School Officer and 
State-Board® tn carrying out responsibilities. 


Proposition #4: The problems in SEAs are” 
complex and varied; there are few, if any, 
ready-made solutions 


Proposition #5; A major thrust of the project 
should be development of a utilization 
mechanism based on identified SEA staff de- 
velopment needs. Thus, a principal concern 
will be for identifying and synthesizing exist- 
ing programs and practices, in addition to 
creating new ones. _ 7 


Proposition #6: Programs should be directed 
primarily toward the development of team 
competencies, and centered on organizational 
goals and objectives. 


Proposition #7: In most instances, programs 
for SEAs should be provided on-site. 


ye 
*1t is recognized that not all states have governing boards 


S 
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Marketing of , 
Programs | 


Needs 
‘Assessment 


, ’ 


Talent and 
Resources 
Within SEAs and 
Other Sectors 


SelhSustaining 


Organization 


. 


Autonomy of 
Permanent 
Organization 


Training of 
Management 
Staff 


Organizational 
Processes 


Extra-Agency 
Influences 


. 


* Proposition #8: The design of the SEA/Staff 
Development Project should include a plan 
for maxihum dissemination and diffusion. 


Proposition £9; An essential component of the : 


SEA/Staff Development Project will be 
devoted to providing knowledge and skills in 
needs assessment in order that SEAs might 
most effectively meet the demands - 
renewal! < 


Propostion #10: There are great talent and 
resources within State Education Agencies 
and other grganizations that should be util- 
ized in any staff development. 


Proposition #11: If the SEA/Staff Develop- 
ment Project works out well, and if feasible, 
consideration should be given to creating 
@ permanent organization for staff devel- 
opment. 


Proposition #12: To assure maximum effec. 
tiveness, @ permanent organization for staff 
development should have a high degree of 


autonomy. 


Proposition #13: The. major target fdr pro- 
grams is confined to the Chief's management 
team and the level below that. 


Proposition #14: The content of programs will 
be directed toward organizational processes 
rather than at “subject” areas — such asearly 
childhood, vocational education, ete. 


Proposition #15: Staff development programs 
in SEAs should include consideration of 
extra-agency forces and influences. 


Performance-RBased Appraisal: A Growing Imperative 


Just how timely is the development of an ‘appraisal system based on per- 
formance criteria can best be appreciated by examining several developments 
that are certain to exert enormous impact on the educational community. Not 
only state education agencies but all educational institutions are likely to 
feel the growing weight of developments. *Beginning with the Griggs vs. Duke 

‘Power decision in 1971 -- and moving: in ‘exorable steps--the U.S. Supreme 
Court and various lower courts established clear requirements for objective, 
relevant criteria for screening and selecting personnel ‘for jobs, promotion, 
and training. ‘Stating the Court's opinion, Chief Justice Warren Burger said, 

"What Congvess has commanded is that any tests used must” ‘e the person 
for the job and not the person in the abstract. In severaF ot ther cases, , 

* most notably the Chance/Mercado suit against the New York (ity Board of - 
Examiners, U.S. District Court Judge Walter R. Mansfield, acting two years 
after Griggs, ordered the Board of Examiners to use processes quite similar 
to those developed by this pralecr. ¥ 


‘On still another front, the federal Education Anadis of 1976 include 
stringent provisions for overcoming sex bias and stereotyping in all federally- 
supported vocational education programs. Under this legislation, the states 
will be required to disclose fully, and-in specific terms, the number of 
women in administrativé and policy-making positions and “to develop plans for 

_ correct ing inequities in employment and training. It is apparent that’ tools 
and processes devéloped by: this project wilI be extremely useful to SEAs in 
‘their attempt to meet new federal requirements. 


Considerable activity in litigation and legislation centers on questions 
of employment equity for: women’ and minorities. Although a major emphasis in 
industry has been on creating performance-based processes for screening and 
selection of personnel, the p t has concentrated on developing appraisal 
processes suitable for di ing, staff development needs. A major concern 
y of the SEA appraisal System. This can be done 
diagnosis/training are kept’ separate from the pro- 
d selection. 


’ 


recent. research on. the use of. an AT&I assessment-center version 
for prpefnployment purposes underscores the possilbe benefits of a sound ap- 
ere Bret: These are ‘discussed by Edward Thigpen: 


"1. New enn lovecd spend less time in orientation. Orientations 
of two weeks have been Saaeaol to 3 days. 


"2. Managers are quite pathintaset about training new people 
because they have been involved with them in the program 
and are committed to their success. 

. 

"3. Trainers find it easier to peer because of a high de- 

gree of motivation and enthusiasm generated by new appli- i 
_ canfs.. : 

"4. Turnover which ran 10% among new hires has been reduced... - 
to fess than .06% of those hired during the 2-year period. 
The cost reduction in this factor alone pays for the. : 
program many times. 


* m3 . 


"5. Applicants who were interviewed after a year were found to . 
* be enjoying their ‘jobs and to be’ performing efficiently. 


"6. The quality factor in their work still remained high and 


supervisors had very few problems with initiative or com 
munications. ''* 


It is not inconceivable that SEAs might enjoy similar benefits from 
an appraisal process adapted. specifically to their needs. 


* 
Procedures: An Overview ~_ ner 
Conventional approaches were used'to determine the "state of the art'' in 
staff development, in general, and needs assessment processes, in particular. 
Interviews with the staff of six SEAs revealed that the principal con- 


concerns of SEAs are how to improve their management, capability and commun ica- 
tions within SEA and with their various constituencies. 


Concurrent with face-to-face interviews, a comprehensive review of the 
literature was undertaken using the North Carolina SEA ERIC retrieval capa- 
bility. Out of this research, the project produced a twenty-page document, 
"Staff Development in State Education Agencies: An Annotated Guide." 


Also during this period, a number of survey instruments and processes 
‘were examined. Sane proved to be extraordinarily good: for example, that 
of the U.S. Civil Service Commission (presented in a special project paper) - 


and that of Dr. Edward Foulker, U.S. Department of Ayriculture Graduate 
“School . None of the many survey instruments, however, is completely 
appropr ate for use in assessing, the definitive staff development needs 
Of SEAs. And, if a diagnostic process is to be of value, the determina- 
tion of relatively precise discrepancies is essential. 


After developing several forced-choice surveys, the printed-survey 
approach was abandoned as unfeasihjie because it proved impossible to 
capture definitive data on staff development needs in this way. Thus, it 
was determined that direct interviews with chiefs or their designates 

“were a more fruitful approach. Twenty sets of interviews confirmed 
earlier interview findings, i.e., the overriding concern in SEAs lies in 
the area of management and communications. 

‘ 


, 


‘ : New 
*''Preemp loyment Assessfrent—-A Systematic Approach to Selecting 
Employees,"' in Assessment and Development, Vol. IV, No. 1, March, 1977. 
Pittsburgh, Pa.: Development Dimensions, Inc. 
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Meanwhile in meetings with the Task Force, tvo far-reaching decisions 
were made: (1) if the project were to develop or utilize training pro- 
grams, the programs should not encompass content areas, such as school 
integration, declining enrollment, schoo! finance, etc. Rather, staff de- 
velopment should focus on generic processes; such as management, planning, 


* data management, evaluation, needs assessment, etc.; (2) rather than 


attempt to create staff development programs, the project, and #hy suc- 
ceeding organization should broker staff development services to SEAs; 
that is, serve as a kind of matchmaker between determined: needs and 
promising.interventions. These two decisions -- to eschew substantive 
-programs and to serve a brokerage function -- resulted in a profound shift 
in the project's direction by focusing the mission more finely. Indeed 
the concept of a match-up service -- as shown on the following page — 
emerged fram these two conceptual shifts. AL] this demonstr@tes that pro- 
jects dealing with a complex universe deal with considerably more than 
products; ‘ther® is an on-going ess of problem refinement. It is hardly 
surprising that a sizeable gap uld exist between the project's problem 
or mission, as originally given or stated and the problem or mission, as: + 
finally understood. It is’a credit to the Task Force that it was at: least 
as interested in identifying the mission of the project as it was in 


creating a product. rs. of the Task Force demonstrated over and over 
that they were not interested in any ''quick fixes''. , 
°? . Ps \ a 
i 
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SEA/STAFF DEVELOPMENT PROGRAM MODEL 


‘Stat Appraisal Service 


Functions 


Perform job analyses 
Formulate the job descriptions 


Diagnose staff development 
needs t 


Screen personnel , 


Cdhduct appraiser training 
. 


SEE, 
tt | 
. Revise as Necessary Gi aT Wy Hl a 1 


Match-Up Service 


Research & Evaluation 


Functions Functions 
Conuuct continuing research 
to determine efficacy of 
various programs 

. 


Select programs on basis Of 
identified discrepancies 


Identify existing programs 
based on-needs 


Coordinate programs to meet 
specific requirements 


Organize workshops and 
conferences 


Provide consumer information 
on program eftectiveness and 
cast ; 


.* aN Ye, = : é 
_,* Much credit goes to Dr. ‘Byron W. Hansford, Executive Secretary of the 
- Council of Chief State School Officers, for-he'lping us keep our ''cool" “ 
. during a period of almost ante lerebls ambiguity. He was an exemplar of 
* patience and wisdom. . ; ois 
‘ oN, 
Thus, almost eight months were: required to refine the precise mission 
of the project. It should be clear that this peviod was highly productive 
- fram the standpoint of useful research data. ‘Much information was gained 
about the ‘status of staff development’ in .SEAs; a better reading of SEA 
staff development concerns resulted; and most importantly, knowledge was 
» gained about important developmerits in the area of staff appraisal. The 
overall effect of the work that went on during this period was development 
of a sound theoretical base upon which to build a program. Having identi- . 
fied.the mission in clear terms, a principal task remained: How to. develop - 
a process to determine the precise training needs of SEAs in order that , 
appropriate,objectives and program criteria might be developed. For this, 
the director utilized'the vast resources of trade and professional associa- 
Hien _ government agencies, and industry. ‘ . 


Contacts with. Sarees directors in industry were highly productive 
For years industry has been involved in developing and using processes to 
determine knowledge and skill discrepancies fot purposes of training. 
Being results-oriented, industry programs tended to be more easily validated. 
Since Griggs vs. Duke Power, there has been increased attention, in both the 
nublic and private sectors to creation of valid performance-based appraisal 
processes. After examining’ same of these programs, there was concern that y 
industry-related appraisal processes would be difficult to translate into 
an educational setting, particularly an SEA setting concerned, as it is, 
. wean comp] ex matters of, state governance, *- ~ _ 
“at this point, the task seemed formidable. Continuing to talk with: 
many people particularly training dfrectorss the project director discussed ; 
his concefn with Richard Arnold, Director of Educational Programs, American® ~~ 3: 
_, Telephone and Telegraph Co. Arnold said he knew of someone who was working 
‘on developing educational applications of the AT&T assessment center process, ; 
a process in growing use in.both industry and government. Investigations 
led to an eventual meeting with Dr. Donald Mitchell, Director of Nova 
University's national Ed.D. program for school administrators. , Nova had. 
made a sizeable investment in developing performance-based appraisal materials 
"and processes for Aocai school administrators as part of its doctoral pro- 
’ gram. Further d. ions ensued with Dr. Mitchell, Dr. Leon M. Lessinger, -” 
- Dean of the School of Education, University of South Carolina, and Dr. : 
Allan Ellis, ok of Educational Research Corporation (ERC). ERC 
had developed ant ae what came to be known as Educational Leader- ~ 
ship Appraisal |( The result’of these and other discussions was a con-. , 
- tract.to pilot ny a of: ELA materials and processes in an SEA. The pilot 
was conducted with womén administrators in the Wisconsin Department of 


Public Instruction. (A fuller .giscussion of the destin eci: of ,an SEA Nye 
sion of ELA is found in the attachment: ) . 


” Encouraged by the Wisconsin ae a the decisiorf was made to donate 
most remaining reSourtes to developing. and testing a modified version of 
ELA that would be appropriate to the idiosyncratic characteristics of SEAs. The 


P ae 


; . . a. ’ 
. project Task Force supported fully this direction. Funds did not permit 


the full development of an’ appraisal system. Although there are sufficient 
ELA exercises to become operational, one or two additional exercises would 
strengthen the system. As it now stands, the process developed:by the SEA/ ‘ 
Staff Development Project with the col laborat ion and assistance of ERC 
represents a quantum leap in the appraisal of SEA staff development needs 

at the middle-management level. Indeed, there is an incipient capability 

to provide performance-hased appraisal services to SEAS across the nation. 
(See following report.) : 


Conclusions and Reconmendat ions } 3 Z 


‘1. Because funds did not permit sufficient field-testing, 
continued field-testing and revision of the appraisal 
system are necessary. 


““®2<" On the basis of extensive interviews with SEAs, it is 
“clear that SEAs on the whole, have inadequate means for 
ascertaining their staff development needs. The develop- 
ment of a performance-based appraisal system is obviously 


a step in the right direction. It is envisioned that : a 


extensive use of performance-based appraisals will result 
in a highly useful taxonomy of management and leadership i i} 
skills in SEAs nnee could prove higely beneficial. f+ k 


aes ee & suffi icient ee capability is to be developed, 
ideally, a coterie of ‘SEA staff should be trained in the 
use of the appraisal process. At training-of-trainers E 
capability should be developed in SEAs in order to expand 
the use of performance-based appraisal practices. This 
can be done most effectively, perhaps, on a regional 
Basis. Assiduous attention, however, ‘mist be given to 
questions of standards and control in both training pro- 
grams and the certification of trainers or appraisors. 


4. To protect against abuse of the process, a code of ethics 
for the appraisal process' use is essential. Particular *, 


_ eare must be given to the proper separation n of appraisal: 


for staff development _purposes and nppraisel “for the 
purposes of.screening and selection. 


” Bs Work should begin immediately to ‘develop a match-up service 
in staff development for state education-agencies. Such a 
_service involves a clearinghdlse of programs codified by and 
matched to documented needs. oe 
6, ELA should be offered as one valuable tool to assist SEAs 
in meet ing provisions of federal hai aimed at re- 
.ducing sex bias and sex stereotyping. 


7. Serious attention should be given to the creation of a f 
. permanent national mechanism for delivering appraisal and ; 
match-up services oh a continuing basis to SEAs. This might 
be effected by a consortium of interested SFAs. 


. : -8- 


4 


\ if a * 
8. It*is lear that Bitenas and universities, ae large, 
' do not, or are not in a position to serve the needs of 
SEAs.’ Therefore, graduate programs must develop greater 
sensitivity to the educational and training needs of SEAs. 


Wise use of a‘ performance-based appraisal process can 
assist SEAs to develop clearer specifications for.SEA | 
programs in their discussions with higher’ education in- 

. , stitutions or other training agencies. 
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ey report. Although a report was submitted to project as part of ERC's contrac- - 
agreement, the project director has made edit rial and gubstantive changes that 
en not netient the philosophy of ERC. 
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During the spring of 1976, Educational ‘Research Corporation (ERC) be- 
gan to develop, with assistance’ from the SEA/Staff Development Project of 
the Oouncil of Chief State School Officers, a system of Educational Leader- 
ship Appraisal (ELA) exercises, specifically relevant to the roles of mi‘ddle- 
management personnel -in state education agencies i ae This enterprise 
was prompted by Dr. James Oonner, Director of the /Staff Development 
Project, who had d&teymined through hfS studies that the central concern in 
SEAs lay in the are& Of management or leadership skills. ; 


ELA is a performané-based procedure ‘for the observation, assessment, 
and training of leadership behavior in educational managers and adminis- 


trators. sting ELA exercises were relevant to the responsibilities of : 
local administrators. ERC's task was to create a system pe, oe a { . 
on the middle-management position’within a state education agency. is * 


new SEA/ELA system appraises an individual along twenty leadership dimensions 
hat are grouped into the broader categories of Management and Organization, «+ 
Communication, Problem Solving, Task Ortentation and Interpersonal Qualities, 
(Appendix A). Behavior along the leadership dimensions is elicited through 
a set of individual and #roup- situational exercises, role-playing tasks, 
analysis problems, interviews, and writing and speaking assignments. This * 
report describes the devglopment of the new SEA/ELA system. 


PROCEDURES ‘ eae " 
‘ . ! *, ‘ . : ; , “te ie 
Our first step in the development of this new set. of SEA-Based ELA exer- - 
cises was to administer the existing public school administration ELA exercises 
‘to members of the: Wisconsin SEA. The positive feedback from this experience 
indicated that the approach that ELA represents could operate as a menas of ' 
determining the development needs of SEA personnel. Thus, after conversations 
with Dr. James Oonner, ERC ccntracted to develop and pilot-test an ELA system 
geared to SEA middle managers. ; : _ 


, 


In order to develop exercises appropriate to. SEA management pérsonnel, 
ERC had to analyze the components of an SEA middle manager's job. First, 
we chose, from among several job analysis techniques, one which we felt would 
be most helpful in identifying leadership dimensions required by these positions 
and in determining behaviors that are critical to the success of an SEA middle 
manager. sing the principles of this technique (Flanagan's critical inci- 

. dents technique) we developéd a job analysis interview format (Appendix B) 
which would produce the information we needed. We-chose to construct a rather 
open-ended form so that interviewed managers could be free to discuss all as- 
pects Of their jobs. Instructions to the interviewers (all ERC staff) were 
detailed enough so that each interviewer gathered very Specific and useful 
data. ¢ é 


# 


* Using this*form, four ERC staff members interviewed eight middle managers 
of the Rhode-Island Department of Education (RIDE) .2 We asked about their 
roles and responsibilities, their working relationships with others, and their 
frequent contacts, as well as specifically. gathering detailed information about, 
and samples of, their mail, current projects, phone calls, visitors, calendars 
_ Teference, materials, and environment. : » 


’ Because the exercises to be developed were to be appropriate for all SEAs, 


a @ greatly appreciate the time and effort t e Slan rtmen 
of Education contributed to this project. 
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ae el than specific only to Rhode Island, we then sought a broadér per- 
ive on SEA activities by requesting and collecting descriptive thor 
mation (such as personnel policies, job descriptions and organizational - 
charts) from seven other SEAs: New. York, Vermont, Michigan, California, 
Iowa, Georgia and Texas. : 


In addition, we reviewed feedback we had received from the Wispeokin 
\SEA personnel who had taken our Public ‘school admintstrator ELA exercises 
earlier in the year. From them we had requested ideas of how that form of 


~ ELA might be to become more appropriate for SEA managers. Their 
suggestions incl a change in setting, more emphasis on work with bud- 
gets, more items relating to the polit issues in staté ‘government, and 


an increased emphasis on requiring th participant to think on his/her feet. ° 


Particularly in response to their indication of \the need for political 
items from the governor's office Sr legislature, we gathered information 
about the relationship between thé state legislature and the SEA by inter- 


viewing Senator Walter Boverini, Chairman of the caer ia all in.the , ° 


Massachusetts ‘State Senate. | 


Finally, having distilled the information gathered from all these sources, 
ERC senior staff returned to Rhode Island for a discussion st eh three members 
of the RIDE management team. Drawing on the results of our. investigations 
to date, we presented our perceptions of the important ions of the SEA's 
middle manager's job. In turn, the management team specified for us certain 
critical incidents--specific behaviors in particular situations--which they 
had observed es contributing significantly to the success of middle managers. 
Among the points about middle managers that weré raised in this discussion 
were : >, 
- They should be able to franaiate objectivesinto’ action; 
that is¢ they should be able to analyze the rent tags 
needed to accomplish ‘objectives. The management t - 
mentioned that doing this well requires the abili 
‘think logically, to analyze, and aa put the resul ' 
analysis in writing. 


. 


- They are expected to think in at least’ tho-year time spans. 


7% 7 
- They should be sensitive to, and be able to react to, different . 
audiences, including teachers, principals, the press, special 


interest groups and the like. . ent 


- They have td know how to handle money and to make decisions 
about it. 


- They try to do too much Pann ane they have problems in 
delegat ing to others. . 


* - They should have a sensitivity to court decisions and to “osm 


Khow when to go for legal help. 


- They generally possess strong oral commmication skills, 
‘ . which are viewed important to their job. 


20 
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- They frequently have to analyze problems. The management 
team considered problem analysis to be especially important, 
and mentioned, for example, the importance of finding and 
analyzing the issues that are implicit in the letters middle 
managers receive. > 
t 
Returning to ERC, we began to plan, as a team, what dimensions should 
be elicited by each exércise and what settings were appropriate for SEA‘ ex- 
ercises. Several conferences were held with Dr. Conner to assure con- _ 
+ tiquity between ERC's 'effors and the "real,world of SEAs'' as determined 
by his research. This cross-checking ‘continued throughout the project. 
Individuals and pairs of ERC staff then began work on eight categaries 
of exercises—Administrative Action, Leaderless Group Discussion/Unassigned 
Role, Quéstion and Answer Period/Unprepared, Written Report/Prepared, | 
Analysis Problen, Leader less ‘Group Discussion/Assigned Role, ong Giger 
Information, and Oral Pyesentat ion/Prepared--which age described he 
‘following pages. , 


- 


oISs 


’ 
CATEGORY OF EXERCISE: Administrative Action 


The Administrative Action category presents items which range from 
day-to-day interna] management problems to questions of policy and.planning. 
In dealing with these items, the participant must make decisions, delegate 
responsibility, write letters, assign work, plan, organize and schedule. 


NAME OF EXERCISE: Ad4<Stant Executcye Commissioner's or Superintendent's Exercése 
‘ j 


-Many critical problems and challengeS of dn upper-middle level manager in 

a state department of education are presented in this exercise wherein the , 
participant is asked to deal with the accumulated notes, memoranda, letters, 
requests, and other pending action items that confront him as he takes over 

A new position as Assistant Executive Commissioner of Education. 


, 


LENGTH: 3 hours: pending action items 
1 hour: ‘report on reasons for decisions and actions 
as needed: Participant Report Form 


LEADERSHIP DIMENSIONS APPRAISED: 


Primary ‘ Secondary ee 
7 : 

Planning and Organizing Creativity 

Management Control Flexibility 

eed Delegation Risk Taking 

Wri 


ten Communication Skills ‘ 

Problem Analysis : 
Political Behavior ‘ 
Judgment 

Adaptability 

. Initiative 

Individual Leadership 

Decisiveness va 

Cons iderateness 
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CATEGORY OF EXERCISE: Leadenrtess Group Discussion/Unassigned: Roles 


Participants in an unstructured, cooperative, leaderless group discussion ‘ 
are asked to submit written recommendations within a specified time concerning 
an assigned problem or problems. 


e 
* ¥ 
+} 3 


2 
NAME OF EXERCISE: Job Applicant Review Exercise 


Three to six participants meet to review the resumes, recommendations, and 
performance ratings of three finalists from among the outside applicants 

for a Bureau Director's position in a state department of education. They 
must produce a list of each candidate's strengths and weaknesses, and they 
must rank them, reaching consensus on the best outside candidate for the job. 


LENGTH: 20 minutes: briefing and review of material 
} 30 minutes: meeting 


10 minutes: listing of strengths and weaknesses and ranking 
as needed: Participant: Report Form 


aa ° 
: : 
! ren DIMENSIONS APPRAISED: 
Primary ° Secondary 
Oral Communication Skills Political Behavior 
Persistence Judgment 
' Initiative Stress Tolerance 
Group Leadership , Considerateness 
Problem Analysis Adaptability 
DOecisiveness 
Flexibility 


- Planning and Organizing 


Pay Wy ee 


CATEGORY OF EXERCISE: Question and Answer Period/Unprepared 


This category measures a participant's ability to respond to questions and 
problems in public without preparation, think clearly on his/her feet, : 
quickly grasp the essence of complicated questions, be articulate in defense 
of stated positions, explain complicated issues, respond to individual: 
requests for guidance, and relate appropriately to all levels of audience. 


‘ 


NAME OF EXERCISE: Television Guest Appearance Exercise 


This exercise simulates the atmosphere and pressures of an unrehearsed 
television program in which the participant plays the role of the special 

guest who must answer. questions and defend positions on educational issues 

as questions are telephoned in by members of the viewing audience. The 
exercise calls on the participant to answer questions on a variety of topics 

as posed by individuals who vary substantially in their level of sophistication 


with regard to educationd] issues. 


. 


LENGTH: 10 minutes: question and answer period 


» 


LEADERSHIP DIMENSIONS APPRAISED: 


Primary Secondary 1 
« - 7 
Oral Communication Skills Problem Analysis 


Stress Tolerance Political Behavior 
Educational Perspective Judgment 
4 Adaptability Individual Leadership 
Flexibility ' 
Decisiveness \ 
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CATEGORY OF EXERCISE: Written Report/Prepared 


This category of exercise measures a participant's ability to conceptbalize 
- issues and problems and to express them clearly and persuasively in an “ 
organized, written form. ‘ ; 


4 


» 


- 
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NAME OF EXERCISE: » Control of Education Written Exercise 


"Given some briefly stated background information concerning the issue of the 
current struggle among various factions to gain control over public school 

‘ educdtion in the United States, participants are asked to prepare a carefully 
and persuasively wr: n statement which describes their perceptions of the 
reasons for, and thé factors involved in, the current struggle for control. 
They must also make recommendations as to the degree and type of control. which 
they feel should be exercised by each of the competing sectors, being explicit 
in stating short-term and long-range implications of their recommendations, 


LENGTH: 1-2 weeks: preparation period 


LEADERSHIP DIMENSIONS APPRAISED 


* Primary ‘Secondary 
Written Communication Skills Political Behavior - 


Educational Perspective 


* CATEGORY OF EXERCISE: Analysis Problem/Wnritten Presentation 


The ability to sift through data, come to a conclusion, and then present a 

logical argument to back up the conclusion may be observed in these exercises. 
Participants are given data on a situation and are asked to prepare a { 
written report or’write letters-recommending appropriate courses of action. 


. 


ye 


NAME OF EXERCISE: Equal Opportunities Exenoixe _ * 


The participant is given the three-year plan of a division in asState depart- 
ment of education along with supporting data such as a budget and the results 

of a needs assessment. After analyzing the data the participant must revise 

the division's plan and its budget. Finally the participant must prepare a press 
release about the future direction of #ene=atvTS Tin. 


' 
‘ . 


LENGTH: 2 1/2 hours: analyze data/prepare commissioner's report and 
+s ee release 
as needed: Participant Report Form 


LEADERSHIP DIMENSIONS APPRAISED: 


Primary | Secondary 
Planning and Organizing Political Behavior 
Written Communication Skills Risk Taking 
Problem Analysis Creativity 
Judgment Considerateness 
Initiative Adaptability 

‘ Decisiiveness : 

a 
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CATEGORY OF EXERCISE:  Leadertess Group Discussion/Assigned Roles “rr 


Acting as both individuals and team members, six participants must allocate 
funds or. make omer judgments on a variety of conflicting proposals offered. 
Each participant 145, assigned a viewpoint to sell to the other team‘members. 
Each h@s two tasks: * (1) to sell his or her assigned position and (2) to = » 
aid the group in making the best decision. d 


—— 


“ 


NAME OF EXERCISE:  Stonefellow Foundation Exercise 


The Board of Directors of the Stonefellow Foundation is meeting ‘to allocate 
a one million dollar grant to worthy projects in its headquarter city, Johnson 
Falls. Members of the Board are provided with a proposal from an organization 
in Johnson Falls (e.g., Youth Board, Urban Renewal Copmission) and are asked 
to get as much money as possible for their pel ager hep The exercise provides 
participants with a choice of projects to back and the opportunity to bargain 
on “a off projects for support. The Board must allocate the money in the 

- time allowed. : aS ise . , 


LENGTH: 20 minutes: role assignment, briefing, preparation 
45 minutes: meeting 
as needed: Participant Report Form 


& 


LEADERSHIP DIMENSIONS APPRAISED: 


* Primary ds ; Secondary 
Oral Communication Skills Planning and Organizing P . 
* Persistence Problem Analysis . ™ 
Initiative ° ' Political Behavior ° 


Group Leadership * Judgment . 
" : Risk Taking 

Considerateness } 
Decisiveness é 
Flexibility oe 
Stress Tolerance +m-<-— nce baliacasiapalance Rad tains 
Adaptability : . 


he 


© CATEGORY OF EXERCISE: Background Information 


Actual past, current, and anticipated career-related information is elicited 
. “from the ‘following exercise as if it were generated from an\interview with 


the participant. 


4 ~ ; ~ : ‘ led 
NAME OF EXERCISE: Background Questionnaire ik ¢ 
i) 
Participants are asked to complete an extensive background information form 
which requests details not only on their past and-present employment and — ox 
education, but also on their job preferences, goals, professional and personal 
accomplishments, means of handling job related activities, and personal “ 
strengths and weaknesses. : : 
, 6 a 7 


LENGTH: 2-4 Hours oe ; , 


* 


- ex 


e 


LEADERSHIP DIMENSIONS BPORRTSED: 


Secondary Pe 


Use of Delegation 

Management Control 

Risk Taking 

Creativity 

Persistence 
Stress Tolerance - a 
Individual Leadership 

Planning and Organizing ,- 


Is CATEGORY OF EXERCISE:  Onak Presentation/Prepared 


This category of exercise measures a participant's ability to make a per- 
suasive, clear presentation of ideas and supporting evidence with time ° 
given for preparation, in a formal, organized delivery. 


NAME OF EXERCISE: — Control of Education/Prepared Speech Exercise 


The participant must make a formal, prepared speech in which he/she presents 
recommendations to the Council of Chief State School Officers concerning steps 
which the Council, as an organization should: take to help in implementing 

the participant's own recommendations regarding the degree of control which 
various sectors should exercise over public school education in the United 
States. The participant is asked to be directive in presenting recommendations 
for the Councilis leadership activities. 


LENGTH: 1-2 weeks: preparation time | 
7 minutes: oral presentation 


LEADERSHIP DIMENSIONS APPRAISED 


Primary ‘. Secondary 
Oral Communication Skills Political Behavior 
Educational Perspective Stress Tolerance 
: ’ Group Leadership 
Adaptability ~ 
i Decisiveness 
hl aleen Fe 
* 


At each stage of its development: each exercise was reviewed and 
criticized by staff members who had not been involved with its creation. 
Revisions and alternatives, solicited by the writer, were weighed and in- 
corporated when appropriate. Together and apart, we fashioned exercises 
which withstood our peers’ scrutiny and which would apparently elicit a 
» desirable range of behaviors along the agreed-upon leadership dimensions. 


ERC arranged two means of obtaining feedback about the exercises: 


(1). a review of the exercises by members of the RIDE 
managenent team and by eight observers' representa- 
tives from other SEAs; and 


(2) a two-day pilot test of the exercises with RIDE 
middle managers. * F 
b 


- Review of the =" oo “%s : 
On October after giving a short introduction, we gave the adminis- 


trative action exercise to the SEA representatives and to members of the 

RIDE management team, allowing them an hour to look over and/or partially 
‘complete the itens. To improve’their understanding of the appraisal process, 
we then reviewed a few items with them, discussing the range of their re- | 
sponses and the dimensions of which they were indicative. “We also solicited 
their opinions of the exercise, finding generally that they felt the items + 
realistically represented the job of a banaiger in an SEA. j 


Following this, we asked the group to 100k over te oral presentation 
(‘Control of Education") exercise, so we could obtain its feedback. Most 
felt it was appropriate. The only major objection raised was that it might 
be too difficult for middle managers. However it was our view, which was 
Supported by members of. the audience, that the issue is not so much what 
middle managers can do. but what ideally they should be able to,do. This. 
means that involvement in exercises can be frustrating for some. Frustra- 
tion is, however, not a wholly undesirable condition; indeed, it may even 
be salutary in terms of training benefits. , 7 mes 


The four questions to be asked participants after theiy oral presenta- 
tions were then asked of four of the RIDE managers, giving them a sense of 
the behaviors we look for in that exercise: It is designed, among other 
things, to measure how well one is able to think and speak without preparation. 
The general opinion seemed to be that the questions were quite appropriate. - 


In the afternoon, while six of the group prepared to participate in the 
assigned role group discussion, the remainder explored with the ERC staff some of 
the leadership dimensions which that group exercise would bring out. Then, 
while the six actually discussed the problem they had been given (what to do 
with the Stonefellow Foundation's surplus funds), the rest of the, group acted 
as observers/appraisers in an effort to. discern behaviors which.were.indica-....... 
tive of strengths and weaknesses on the various dimensions. At the con- : 
clusion of the exercise a discussion of observed behaviors made it apparent 
that extensive appraisal training will be needed for complete and reliable ~ 
observations to be assured as SEAs administer the exercises themselves. 


| ! 
oe | ae 


athe 
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The SEA observers, Allan Ellis and Normal Becker of ERC, and James 
Conner met the following day to discuss various procedural matters for 
disseminating the exercises, giving their feedback about how the ELA 
exercises might be handled. The topics discussed included who should hold 
the copyright, how to assure quality control of appraisals, the need for 
training of SEA people who will use the exercises, and the role of the 
Council of Chief State School Officers in the dissemination process. 


Pilot Test 


The ERC staff also pilot-tested exercises with 10- members of RIDE. 
middle managenent. Explaining that these middle managers were to see 
themselves both as participants and as consultants to the exercise, develop- 
ment process, Dr. Leonard Glick outlined the ,reasons for the pilot testing 
and solicited their honest comments and criticisms. The group then took the 
administrative action exercise for 2-1/2 hours, until lunch. They devoted 
their afternoon to a discussion of individual items from the administrative 
action exercise, the range of responses they had elicited, and the dimen- 
sions such as management control and delegation, giving illustrations of 
strong and weak behaviors in these categories. The general feeling was 
that most items. wer€ appropriate and rich enough to elicit a variety of 
responses. 


The following day the 10 middle managers piloted four exercises: the 
prepared oral presentation, the unprepared questjon-and-answer session, the 
analysis problem,and the unassigned role group discussion. In the morning 
they were divided into two groups. For one hour Group 1 prepared oral 
presentations while Group 2 worked for two hours on the analysis problem. 
Following the individual taping of his prepared talk each Group 1] participant 
was given an-opportunity to review the analysis problem until the two hours 
had elapsed. When work on the analysis problem was complete, the last two 
participants from Group 1, who had not yet taped their speeches, gave live 
presentations in front of the entire group, followed by the question-and- 
answer period. Mary Havelock of ERC, who had observed a]l the oral presenta- 
tions, then led a discussion of the two oral exercises, including their 
vurposes, the dimensions they tap, and the range of behaviors which can be 
expected on them.. Although some managers with business (rather than educa- 
tion) backgrounds found the oral presentation subject out. of their field of 
expertise, the point was made that normally participants would have two weeks 
to prepare the talk and would thus be able to fully research any aspects of 
the question with which they were not thoroughly familiar. 


In the afternoon, Mr. Becker went over the analysis problem with the 
participants, who generally approved the appropriateness of the setting, as 
well as the type and camplexity of problem ERC had chosen to present. 


Then, four members of the group prepared for the unassigned role group 
discussion while ERC staff trained the other members to observe the discussion 
~-e~-dn-order--to-identifybehaviors.illustrative of various dimensions, Each was_ 
assigned to observe two discussants. When the discussion had been held and 
observers compared notes, they found enough evidence to believe that inter- 
rater reliability was possible with sufficient training. That is, people who 


me icy eae 
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had been assigned to watch the same participant in general picked out the 
safne behaviors as significant and gave comparable estinntes of their 
meaning. 


Concluding the pilot test, Mr. Glick explained thas while ERC had em- 
phasized training during this pilot test, actually the exercises are at 
least equally valuable for leadership appraisal purposes. . He then detailed 
for particiapnts the steps in the complex appraisal process which ERC on 
to produce valid leadership profiles for participants.’ ; 


Analysis of the ELA System for SEAs 


Since the pilot test, ERC has conducted much more detailed analyses of 
all the SEA exercises, revising them in response to participants’ comments 
and performance and as a result of ERC staff observations of their effective- 
ness, While’no revision was major, the exercises did require several dif- 
ferent kinds of revisions. For example, we replaced a few items in the 4 
. administrative action exercise, and we modified others so that the exercises 
would do a better job of eliciting behaviors relevant to the dimensions. We 
developed sets of very specific directions for the two group discussions as 
well as modifying their participant report forms. We carefully edited the 
analysis problem to clear up a few ambiguities and revised one of the charts 
in this exercise. In short, we were pleased that the pilot test had.se 
its purpose in revealing the need for certain pinor revisions in the exercises. 


While the revisions have strengthened the cess nes: it is important to 
note that, because of budget constaints, ERC never intended to create a- 
complete ELA system as part of this contract. And, although the eight exercises 
comprise a fairly extensive systen in their own right and appear to be capable 
of measuring most dimensions quite well, ERC believes that two additional - 
exercises would strengthen the system and make it even more comprehensive. 
First, it would be desirable to create an Observation/Judgment exercise, where 
the participants view a video tape or film.and are asked to draw conclusions 
about the people in the film and the positions they take. This exercise would 
enrich the systen, because it would require the participants to acquire infor- 
mation by listening and observing processes which generally are not stressed 
in the other exercises. In addition, it probably would be possible to design 
the exercise to elicit behaviors relevant to two dimensions, risk taking and 
individual leadership, which are not tapped by the current exercises as well 
as one would like. 


Second, we envision the need for an ‘Individual Fact Finding/Decision- 
Making exercise, where the participants are presented with a problem situation 
and are asked to determine its causés by asking relevant questions. Fact 
finding is a skill needed by middle managers. Moreover, this exercise would 
tap behaviors linked to two dimensions which are slightly ufideremphasized in 
the current system, flexibility (remaining open to nei evidence) and decisive- 
ness. : 


4n-additiott to these’ two éxercises, there are certain support materials 
that need to be developed. For example, in order to increase the reliability 
of the appraisal process which is described in the next section, forms that 
guide an appraiser's observations must be developed. There also is a need 
for manuals that provide ich lony to people who use ELA for aici 


~ 


‘Purposes as described later. In summary, then, while ERC believes the 
current set of exercises can contribute greatly to the staff development 
needs of SEAs, not only should support materials for existing exercises be 
developed,’ but the systen also pole be enriched with the addition of two 
more exercises. 


The Future Use of ELA with wail 


2 
There are two%primary uses for ELA. First, it can be used as an 
appraisal instrument to identify staff development needs. More specifically, 
members of an SEA could take the exercises, their performance on each dimension 
would be appraised, and the strengths and weaknesses of each individual (as Yaa 
well as of the overall a could be identified. ‘ 
X As Figure 1 shows, the appraisal process is lengthy and detailed, con- 
sisting of several steps. First, each individual's videotapes of per folmance ’ 
are observed and written materials reviewed.* The appraisers, generally three 
for each individual, then fill out detailed forms for the participant, which 
identify and sort his/her significant behaviors and actions on all exercises  { 
according to the leadership dimensions. In other words, the behaviors noted |) 
are reorganized by dimension (rather than by exercise). : 


The appraiSers who have: observed and reviewed the individual's tapes 
and written materials then assemble for a roundtable discussion of t 
behaviors and actions they have seen. Observations are shared. Afterffull 
discussion, each appraiser on the team individually rates the participaht 
on each dimension. 


The appraisal team then resumes discussion of the candidate. ~The apprais- 
ers complement each other's judgments and provide a broader, richer view of 
the behaviors than an individual could provide. They compare their ratings on 
each dimension ‘and present evidence to each other sted consensus is reached 
on the rating for each dimension. 


The team then analyzes the. appraisee's performance, enumerating his/her 
strengths and weaknesses in preparation for the writing of his/her individual 
leadership profile. One of the team writes the profile, a twenty to thirty 
page report, which specifies for each dimension the candidate's behaviors 
that affected his/her ratings. 


The second potential use for ELA is training. ERC has found that 
participants benefit from a careful review of the exercises in which many of 
the alternative ways of responding to the problems in the exercises and their 
implications are discussed. For example, discussions of the various issues 
- presented in the administrative action exercise and the ways in which partici- 
pants handled them can serve to illustrate proper and improper ways of dele- . 
gating, exercising management control, analyzing problems, and the like. 


. 


° ’ 


*Video taping of certain | exercises allows the opportunity for a more 
deliberate review at a later time. 


\ 
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FIGURE 1 


THE APPRAISAL PROCESS 


Observe video 
tapes 


} - Rate each’ dimension: 
/ each appraiser independently 


* piseass a ephie s ratings until 
’ unanimo team of appraisers 


/ 
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While the review of the exercises serves to teach the participant 
specific skil]s, an even more important function of the review is, 
its capacity to help*a participant to conduct self-appraisals and thereby 
Become more sensitive to his/her own strengths and weaknesses. 


Obviously, the two uses of ELA are not mutually exclusive. There is 
no reason why |SEA personnel could not be appraised and then participate in 
discussions of the exercises and related training activities. In fact, this 
two-pronged approach might be the best use of ELA. 


ea! ‘ 

Whatever|way ELA is used, it is~-important that it be used properly. ERC 
has been very|careful to maintain quality control of its public school ELA 
system and is|conmitted to the same high standards for the SEA system. We 
believe there/are two basic Ways to ensure the proper use of the system. First, 
ERC professiogals who are totally famtiar with the system could /perferm all of 
the appraisal$ and conduct all of the training. While this approach may be . 
reasdnable for some states — for example, those who do not plan to use ELA ss 
regularly -—- jt probably is more expensive and does not_turn over to the states 
the skills ne¢ded to administer ELA. 


The secogd approach, therefore, is for.ERC or some other organization to 


train various}SEA pe 1 in the uses of ELA. Briefly, an organization would 
develop manuals and t training sessions to teach trainees how to appraise 
others and how to use as a training device. At the end of the training 
program, thos 1 would be certified who had successfully completed 

the training p and, therefore, were judged competent to use ELA ete 


Not necessarily all who were trained would successfully meet standards for 
certification} Some individual states might have three or four people trained. 
. Other states, |however, might choose a regional approach, where one state would 
have same pergonnel trained in the. use of ELA and then, upon request, administer 
ELA togpartic{pants fran several neighboring states. In short, there are sev- 
eral possibilities regarding both the uses and users of ELA, but a primary 
concern is that, ,in all cases, ELA be used properly. 


Summary 


. Educational Research Corporation created an ELA system, consisting of 
eight performance-based exercises, geared to the role of a middle manager in 
a State Educaition Agency. Results of a pilot test of the exercises in 

Rhode Island, revealed the need for minor revisions in the exercises but in 
general were jquite encouraging. This revised ELA system appears to have the 
potential to/contribute greatly to the staff developement needs of SEAs, both 
with respect |to identifying training needs and to providing some training 
itself. 


« 
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. APPENDIX A : , 


Dimensions of Leadership 


, A dimension is a descriptive heading under which specific human behavior 
can be rationally grouped and reliably classified. The list of dimensions 
that form the basis for ELA is not intended to be inclusive of all the charac- 
teristics of an educational leader. Moreover no one would be expected to be 
high on all dimensions. Two outstanding performers may have markedly different 
combinations of}dimension strengths and weaknesses. The dimensions are merely 
common areas of‘concern which job analysis studies have identified as being 
important to success or failure in particular positions. 


The fol list presents brief, suggestive definitions of the ELA r 
leadership d ions. Please note that these dimensions have been organized 
under larger headings just for the purpose of convenience. The groupings are 
to be seen neither as exclusive categories nor as the sole focus of the . 


appraisal process. _ 
MANAGEMENT AND ORGANIZATION 

Planning and iz , 
r ~ 

Effectiveness in planning and organizing one's own activities and those of 

one's staff. . 

Management Control ‘ 

5 


The appreciation of need for controls and the ability to exercise maintenance 
of control over processes. 


Use of Delegation 


The ability to use effectively subordinates, colleagues and superiors; and to 
understand where a decision can best be made. 


COMMUNICATION 
Written Conmuinication Skills 


The ability to write a readable, persuasive document that conceptualizes 
issues ‘and problems, is complete, and is ene for the intended 
,audience. 


Oral Communication Skills 
The ability to respond to questions in public; think clearly on one's feet; 

* think behind questions; be articulate in defense of programs; define missions; 
explain complex issues; deal with a problem in publit without preparation; and 
relate to all levels of audiences, 


} 
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. ‘ PROBLEM SOLVING 
Problem Anal , : 


- 


“The ability to read or listen and pick out critical information or issues 
underlying the material ; to seek out pertinent data; to = alternatives 
and ‘their consequences. 


Judgment | a 


The’ ability to evaluate situations and persons and to reach logical con- 
clusions based on evidence at hand. 


Political vior 
The ability to identify what can be accomplished and how it can be accomplished, 
"and to use resources and control the situation so that it is accomplished; 
Sensitivity to the political implications of various acts. 
Decisiveness 
Readiness to make deciSions and to render judgment .. 
* Risk Taking tg . 
= és 
® The extent to which calculated risks are taken based on sound judgment. 


Creativity e 
The ability to came up with imaginative solutions in management situations. 
Educational Perspective 
‘ 
The -of_jnowledge and understanding of fundamental,as well as current, . 
ional,principles and issues and their interrelationships with icationsl 
tional issues. 7 E : 
r s 
TASK ORIENTATION 
Persistence 


The tendency to stay with a seteties" or line of thought until the matter is 
settled. 


* Initiative 


Active efforts to influence events rather than passive acceptance. 


Stress Tolerance 


Stability of performance under conditions of pressure, opposition, and un- 
certainty. , 
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‘Group Leadership __) 


Effectiveness in bringing a group to accomplish a task and in ee new 
ideas accepted . 


Individual Leadership 

Ability to motivate individuals on a one-to-one basis to accomplish a task. 
Adaptability 

sr to modify behavioral style ana management approach to reach a 


INTERPERSONAL QUALITIES 


Flexibility 
Being receptive to new ideas or arguments. ' : . 


donsiderateness 


Showing concern for others and appreciation for their work; treating others 
with respect and politeness; thoughtful toward: others. . 


- 
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“— aa SEA Job Analysis Interview s 

_ Name : | Date _. * : . 
Position : Interviewer aa 
Years with SEA Pa as 


ee 
' 2% ‘ 


ary 


If group interview: 
Name “Position : Years with SEA 


‘. Part: Introduction and Overview of Interview Format bs ‘ be Se 
+ Topics for Coverage . is 


Personal introduction 4 c. . 
ERC affiliation 

a. brief description of organization 
b. definition of ELA 

Work with CCSSO 

a. Wisconsin preliminary work 

b. forthcoming R. I. assessment ; , 
R. I. state.department involvement 
a 
b 


w neo — 


> 


purpose of interviewing _ 

outline of day's activities 

(1) general question and job discussion 
(2) exolan@y of specific tasks 


‘ 


7 


Part II: General Job Description 


1. Would you ‘describe the duties and responsibilities: of your job? (obtain a copy 
of any available written job-description. ) 


\ 


2. How itd you prioritise the duties and veepiauibitities you just described? 
(Im terms of time committment, department goals, personal pratenenes etc.) 


3. Would you desert your working eee. with (1) your immediate supertor(s) | 
and (2 rt those you directly supervise? 


~ 


°@ 


4, Are there other individuals or groups that you work with, ‘both inside and outside’ 
the department, on a more or less continuous basis? If so, who are they and what 
is your working PePaPlonen ty with them? 


a 


5. Do you anticipate that your activities for today will te mere or less typical « 
of a routine work day? If ity how do they differ? 


‘ 


Part III: Review of Tasks 


I would now like to talk with you about specific activities of your job. To assist 
in this process it is most helpful if we look at some of the che tasks you do ona 
"routine work day. ie 
1. Review day's mail. 

2. Review other materials on desk. 

3. Discuss phone call. 

4. Note visitors - who? why? 

5. Review calendar ‘ . 

6. Review other office materials - books, reports, charts. 

7. Tour environment ‘ a t 


mo We 


Part IV: Wénd-up 


(Toward the end of the interview reviéw the dimension list to be sure that you have 
a good idea of the level of ski1l\needed in each area.) 7 


PYanning & Organizing 
Management ControY 

“Use of Delegation 

Written Communication Skills 
Oral Communication Skills 
Problem Analysis 

Political Behavior 

Judgment 

Risk Taking 

Creativity 


ae 


Educational Perspective 
Persistence 

Initiative 

Stress Tolerance 

Groyp Leadership 
Individual Leadership 
Adaptability 
Decisiveness 
Flexibility 
Considerateness 


APPENDIX C 
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* Financial Report 


Amount Expended 


DUPOCESE sas clihvaraicw cn de sciand baie ewds wera weds caw, “ROTO OD 
SGCKCEATY cai sions ss SedakosedacsUveGsareretescevedey . 20504700 


Penge Denetlis 5 véssqcadaces ses ssiasieveceerebewevers ORO ’ 


Task: FOrce TEAVel cic siicdewenetstee nese recncepesseaeewmees. 25457 c00 


Project. .DIirectOe Travel: i iscsi sieecesadsoevews ceeeedeen 4,551.48 2 


Needs Assessment Analysis...........45 
Resource Identification........ 
Prototype Design........ 
Field-Testing Design... f...csscsccccececes 


Pilot Program,.......+.- 


cece eee bececenvens 9,859.29 
Prererrrr errr eer 4,889 69 
sete ate eeareedaesene “MIG OSE 94 


eee ccc ccee tons 5,110.00 


- 


tees ae seetecetvescedvocscne $0,000.00 


Technical AS6iStanCce.......ccseeecencccccveccceenseceecs 3,500 .00., 


Project Report, Mailing, Exercise Reproduction,......... 1,976.45 
Supplies and Materials,.... 


Communications,..... 


Duplication and Reproduction......... saaveteane Se tiave Biaiateeiee 2,153.47 


Office Furniture and Equipment............. a asahereseny anaqeacete 1,856 .98* 


ey 


’ 
sidaiinaueeees ats wwethe Aeiee wuievba tre 2,002 .24 
Pee g eee eee e ee eeee holecwianeis - 3,603.30 
Ghtie fete xaeentececene Avaage ; 
seatana hinge sn8 we Sige erscdsg 908 8984 $e 8g GB 90 {00 
Total Expenditures $195,547.00 
Total Allocation 194,890 .00 
Earned Interest 657 ,00 ° 
Total Recetpts 195,547 .00 
Balance $ "00 


‘ *This expenditure is far less than anticipated due to gifts of of- 
fice furniture from the project director. 
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’ SEA/STAFF DEVELOPMENT TASK FORCE : 
. * e 
‘ Mr. Charles Nix, Chairman f ? . 
Associate Commissioner for Planning ¢ 
Texas Education Agency . r 
. Austti Texas 78711 ‘ 
___ Dr, Stephen K. Bailey Ms. Hope Kading 
. American Council on Education : Vice Chairman 
One Dupont Carcle * Education ission of the States 
Wasbington! D.C. 20036 ? Park Hi 
: Boise. | 83702 
Mr. Bill Bowden ° on 
American Telephone & Telegraph . Dr. Marland 
195 Broadway ‘Re. President 
New York, N.Y. 10007 ‘ College Entrance Examination Board 
‘ 888 Seventh Avenue 
Dr. Jesse Coles New York, N.Y. 10019 
Deputy Superintendent of Planning/Administration 
State Department of Education j Mr. Elton K. McQuery 
Columbia, South Carolina 29201 Assistant Executive Director 
Mr. James M. Connor = bed Solera tia we diate ies é 
President Z Greenwood Plaza : 
National Association of State Boards of Education . & Englewood, Colorado e011d 
P.O. Box 54 ~ 
Kingstree, South Carolina 29556 F Mr. Cart Pf men 
Mr. Thomas B. Doherty , ‘ Carl H. Pforzheimer & Company 
Superintendent of Schools 4 ‘ 70 Pine Street’ 
1115 N. El Paso New York, N.Y. 10005 
Ceterado Springs, Colerate 275) f Honorable A. Craig Phillips 
Honorable Verne Duncan : Superintendent of Public Instruction 
Superintendent State Department of Public Instruction 
State Board of Education 5 Raleigh, North Carolina 27602 
Salem, Oregon 97310 * a chai: Pinengee 
_ Mr. James J. Fishman’ Secretary of Education 
Institute for Judicial Adminstration ‘ State Departmen} of Education 
40 Washington Square, South - Harrisburg. Pennsylvania 17126 
New York, N.Y. 10012 Dr. Witham Sectth 
Mr. Robert Grter - lig rg 
Assisi Siperiattabns tee Uikin ‘hifalce 5 _ USOE —Fteom 
Ohio Depertment Building 400 Maryland Avenue, S.W. A 

Washington, D.C. 20202 
65 South Front Street ANgIONs 
Columbus, Ohio 43215 ° Honorable Barbara S. 

Superintendent of Pubhé Instruction 
ee as Project State Department of Public Instruction 
Schoo! of Law — Boalt Hall Vieeweae ti 
University of California, Berkeley jC teen Sree 
Berkeley, California 4720 Madison, Weeconsen $3703 
Mr. Lie Hamilton Dr. James E. Conner 
Vice President for Public Affairs Project Director 
National Association of Manufacturers SEA/Staff Development Project 
1776 F Street, N.W. 5 Council of Chief State School Officers 
Washington, D.C. 20006 1201 16th St., N.W., Roam, 304 

i Washington, D.C. 20036 4. 

Dr. Byron W. Hansford ch 
Executive Secretary 
Council of Chief State School Officers 
1201 16th Street, N,W., Room 301 - 
Washington, D.C. 20036 ; 

2 , 

‘= SEA/Staff Development Project fs 
‘ Council of Chief State School Officers 
“ 120) Sixteenth Street, N.W. #304 
ae 4 6 Washington, D.C. 20036 is 
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